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NON-STANDARD NONSTANDARD ANALYSIS AND THE 
COMPUTATIONAL CONTENT OF STANDARD MATHEMATICS 

SAM SANDERS 


Abstract. The aim of this paper is to highlight a hitherto unknown compu¬ 
tational aspect of Nonstandard Analysis. Recently, a number of nonstandard 
versions of Godel’s system T have been introduced ( [2]l^l2) b and it was shown 
in that the systems from play a pivotal role in extracting computational 
information from proofs in Nonstandard Analysis. It is a natural question if 
similar techniques may be used to extract computational information from 
proofs not involving Nonstandard Analysis. In this paper, we provide a pos¬ 
itive answer to this question using the nonstandard system from [9]. This 
system validates so-called non-standard uniform boundedness principles which 
are central to Kohlenbach’s approach to proof mining (Cl])- In particular, we 
show that from classical and ineffective existence proofs (not involving Non¬ 
standard Analysis but using weak Konig’s lemma), one can ‘automatically’ 
extract approximations to the objects claimed to exist. 


1. Introduction 

The aim of this paper is to highlight a hitherto unknown computational aspect 
of Nonstandard Analysis. In two words, we show how the nonstandard system 
introduced in [9] can be used to extract computational information from proofs not 
involving Nonstandard Analysis. We provide more details in the next section. 

1.1. A new computational aspect of Nonstandard Analysis. Recently, a 
number of nonstandard versions of Godel’s system T have been introduced (m 
inilll]), based on Nelson’s internal set theory ([H]). Using the systems from [5], 
an algorithm was formulated in m which allows for the extraction of computa¬ 
tional information from proofs of theorems from ‘pure’ Nonstandard Analysis, i.e. 
formulated solely with nonstandard definitions (of continuity, convergence, differ¬ 
entiability, compactness, et cetera). Note that the results from [27] are not needed 
for this paper, but merely serve as a motivation or starting point. 

Intuitively speaking, the algorithm from [27l §3.5] produces a proof of the ‘con¬ 
structive’ version of the theorem at hand (if possible), or the associated equivalence 
from Reverse Mathematics (See |28||29] for the latter) otherwise. Here, the word 
‘constructive’ may be interpreted either in the mainstream sense ‘effective’, or the 
foundational sense of Bishop’s Constructive Analysis] Both cases are treated in m- 
We believe our aims to be best further illustrated by way of an example, as follows. 
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Example 1.1. Assuming basic familiarity with Nelson’s internal set theory, we con¬ 
sider the following theorem: A uniformly continuous function on the unit interval is 
Riemann integrable there. The previous theorem formulated with the nonstandard 
dehnitions of continuity and integration is: 

(V/ : IR ^ R) [(Vx, y £ [0, l])[x f{x) ss /(y)] (1.1) 

^ (V^, tt' G P([0, l]))(||7r||, ||V|| « 0 ^ SM) ^ *5.(/))], 

where, as suggested by the notation, tt and tt' are discrete partitions of the unit 
interval, and ||7r|| is the mesh of a partition, i.e. the largest distance between two 
adjacent partition points; The number ST^{f) is the Riemann sum associated with 
the partition tt, i.e. /(ti)(xi - x^+i) for tt = (0, to,a^i,^i, ■ •.,Xm-i,^M- i, !)• 


By contrast, the effective version of the theorem is as follows: 


(V/ : R ^ R, g, n) (Vx, y G [0,1], fc)(|x - y| < ^ ^ \f{x) - /(y)| < (1.2) 

^ (Vtt,^' G P([0, l]))(||7r||, ||V|| < ^ ^ ISM) - SM)I < i) 


where t is a term from the original language, i.e. not involving Nonstandard Anal¬ 
ysis. In m §3.1] it is shown how a proof of the nonstandard version of (HH) can 
be converted into a proof of the effective version (HID; Furthermore, the term t in 
(O can be ‘read off’ from the proof of (HID- Finally, an algorithm is formulated 
in [271 §3.5] which converts the proof of a theorem of pure Nonstandard Analysis, 
like (11.11) , into the proof of associated effective version, like (11.21) , and also extracts 
the required term t. 


In light of the previous example from we observe it is possible to extract 
computational information from certain proofs in Nonstandard Analysis. It is then 
a natural question if similar techniques may be used to extracted computational 
information from proofs not involving Nonstandard Analysis. In this paper, we 
provide a positive answer to this question. The nonstandard system M, introduced 
by Ferreira-Gaspar in [9] and discussed in Section [T2l below. plays a central role. As 
pointed out in 0 §1-2], M validates so-called non-standard uniform boundedness 
principles which are central to Kohlenbach’s approach to proof mining ([H]). Note 
that Kohlenbach uses the word ‘non-standard’ in [14] to refer to the non-classical 
status of the uniform boundedness principles. 

As to methodology, we shall establish more ‘non-standard’ features of M in Sec¬ 
tion 11.41 which imply the equivalence between the usual e-d-definitions (of con¬ 
tinuity, differentiability, convergence, et cetera) and the associated nonstandard 
definitions. Such an equivalence does not follow from the usual base theory or 
standard principles. 

Thanks to the aforementioned equivalences, a proof of a mathematical theorem 
only involving e-d-definitions, gives rise to a proof of the associated nonstandard 
version in M. From the latter proof, computational information can be extracted 
using (substantial modifications of) the techniques from [^. We treat the funda¬ 
mental theorem of calculus as an example in Section 12.21 while further examples 
are treated in Section 14.11 and 14.31 In Section 12.31 we provide a general template 
for extracting computational information using M from a proof not involving Non¬ 
standard Analysis (but weak Konig’s lemma is allowed). In Section jS] we establish 
the limitations and scope of this template. 
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A particularly nice result is obtained in Section 14.21 namely that from certain 
classical existence proofs (not involving Nonstandard Analysis), one can ‘automat¬ 
ically’ extract approximations to the objects claimed to exist. If the object claimed 
to exist is unique, the approximations converge to the former. Examples which can 
be treated in this way are: The intermediate value theorem, the WeierstraB maxi¬ 
mum theorem, the Peano existence theorem, and the Brouwer fixed point theorem 
(See [291 n.6 and IV.2]) 

In conclusion, we shall use a system of ‘non-standard’ Nonstandard Analysis to 
extract computational information from proofs not involving Nonstandard Analysis. 

1.2. Internal set theory and its fragments. In this section, we discuss Nelson’s 
internal set theory, first introduced in [U, and its fragment M from 0. 

In Nelson’s syntactic approach to Nonstandard Analysis (EH), as opposed to 
Robinson’s semantic one ([21]), a new predicate ‘st(a;)’, read as ‘a; is standard’ is 
added to the language of ZFC, the usual foundation of mathematics. The notations 
(V®*x) and (3®*!/) are short for (Va;)(st(a:) and (3?/)(st(y) A...). A formula is 

called internal if it does not involve ‘st’, and external otherwise. The three external 
axioms Idealisation, Standard Part, and Transfer govern the new predicate ‘st’; 
They are respectively definetiil as: 

(I) (V®* ‘’"a;)(3?/)(Vz S x)(f{z,y) {3y){\/^^x)(p{x,y), for internal ip. 

(S) (Va:)(3®*2/)(V®*z)([z G x A ip\z)] O z G y), for any (p. 

(T) {fl^^x)tp{x,t) —>■ {\/x)ip{x,t), where ip is internal, t captures all parameters 
of ip, and t is standard. 

The system 1ST is (the internal system) ZFC extended with the aforementioned 
three external axioms; The former is a conservative extension of ZFC for the internal 
language, as proved in [2T] . 

In [9], the authors study Godel’s system T extended with special cases of the 
external axioms of 1ST. In particular, they consider nonstandard extensions of the 
(internal) systems E-FIA“ and E-PA"^, respectively Heyting and Peano arithmetic in 
all finite types and the axiom of extensionality. We refer to PJ §2.1] for the exact 
details of these (mainstream in mathematical logic) systems. 

The results in [9] are inspired by those in [2]. In particular, the notion of finiteness 
central to the latter is replaced by the notion of strong majorizability. The latter 
notion and the associated system M is introduced in the next paragraph, assuming 
familiarity with the higher-type framework of Godel’s T (See e.g. pj §2.1]). 

The system M, a conservative extension of E-PA"^ (See [9j Gor. 1]) is based on 
the Howard-Bezem notion of strong majorizability. We first introduce the latter 
and related notions. For more extensive background on strong majorizability, we 
refer to [Ml §3.5]. 

Definition 1.2. [Majorizability] The strong majorizability predicate ‘<*’ is induc¬ 
tively defined as follows: 

• X <Q y is X <0 y; 

• X y is (V'u)(Vu <* u){xu <* yv A yu <% yv). 


^The superscript ‘fin’ in (I) means that x is finite, i.e. its number of elements are bounded by 
a natural number. 
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An object is called monotone if x <* x. The quantifiers (Vx^) and {3y^) range 
over the monotone objects of type p, i.e. they are abbreviations for the formulas 
(Va:)(x <* a; ) and (3y)(y <* y A 

As in m §2], we have the following definition. The language of E-PA“^ is the 
language of E-PA“ extended with a new predicate st”’ for every finite type cr. The 
typing of the standardness predicate is usually omitted. 

Definition 1.3. [Basic axioms] The system E-PA^^ is defined as E-PA”^ + %t + 
where 71* consists of the following axiom schemas. 

(1) x=ay ^ (st‘^(ai) ^ st'^(y)); 

(2) st^{y) ^ {x<*y^ st'^(a;)); 

(3) st‘^(t), for each closed term t of type cr; 

(4) st'^“*"^(z) ->■ (st‘^(a;) -)• st'^(za;)). 

The external induction axiom lA®* is the following schema for any $: 

$(0) A (V'^‘n°)($(n) ^ $(n + 1)) ^ (V"*n°)$(n). (lA'^*) 

Definition 1.4. [Non-basic axioms] 

(1) Monotone Choice mAC“j: For any internal (/?, we have 

^ {3^^fW^x){3y <* f{x)Mx,y). 

(2) Realization For any internal tp, we have 

(Va;)(3"*j/)v?(x,y) ^ (3"*z)(Vx)(3y <* z)(p{x,y). 

(3) Majorizability axiom MAJ“j: (V®*x)(3®*?/)(x <* y) 

Ferreira and Caspar define the functional interpretation Ust in [9j §2] (We in¬ 
troduce it in the proof of Corollary II.6p and prove the following theorem for the 
system M = E-PA“ -P mAC“ -f R“ + MAJ“. 

Theorem 1.5. Let 'l'(a) be a formula in the language of E-PA^^ and suppose 
= (V"*6)(?tc)(/?(&,c,a). If 

M h 4'(a), (1.3) 

then there are closed monotone terms t of appropriate types such that 

E-PA“ h {7b)(p{b,t{b),a). (1.4) 

Proof. Immediate by [9l Theorem 1 and Corollary 1]. □ 

The notion of ‘normal form’ in this paper will always refer to a formula of the 
form (V®*x)(3®*?/)(^(x, y) with (p internal, i.e. without ‘st’. Note that normal forms 
are closed under modes ponens inside M. We now prove that normal forms are 
invariant under Ust, modulo some strong majorizability predicates. 

Corollary 1.6. If for internal ip the formula 41 ( 0 ) = (V®*6)(3®*c)'!/'(x, i/, a) satisfies 
(11.31) . then (V&)(Vx <* b){3y <* t{b))ip{x,y,gP} is proved in (11.41) . 

Proof. Clearly, if for ip and ih as given we have 

4'(a)^=‘ = (V’^‘&)(3"*c)(Vx <* b){3y <* c)iP{x,y,a), (1.5) 

then the corollary follows immediately from the theorem. A tedious but straight¬ 

forward verification using the clauses (l)-(7) in [9l Def. 1] establishes that in¬ 
deed 4'(a)*^=‘ satisfies dlAD. For completeness, we now list these inductive clauses 
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and perform this verification. In particular, we now define Ust which assigns to 
each formula $ in the language of E-PA“^ two formulas and such that 

c), with $[ 7 ^^ an internal formula, according to the fol¬ 
lowing clauses: 

(i) $ 77 ^^ and are simply $, for internal formulas $ 

(ii) [st(a;)]^=‘ = (?‘c)(a; <* c). 

For the remaining cases, if the interpretations for $ and are given respectively 
by = (V®* 6 )( 3 ®*c)<i>c 73 t(^;C) and = (V’*‘d)( 3 ®‘e) 4 'c 73 t('^i e) then we define: 

(iii) ($ V d)(?‘c, e)[<^ujb, c) V 111773 ,(d, e)], 

(iv) = (V^V)(3^t6)[(36' <* b)^^uAb'Jib'm 

(v) ((Vx)$(ai))^"‘ = (V"*6)(3"tc)[(Vai)$c7,t(a:,&,c)], 

where the internal formulas between square brackets are the corresponding lower 
17st-formulas. The previous clauses can be used to derive (modulo classical logic) 
the following interpretations: 

(vi) ($ ^ = (V«t/,d)(?‘6,e)[(W <* b)<^ujb',f{b')) ^ 'i'ujd,e)], 

(vii) ((3cr)<i>(a:))^- = (V^tF)(3^V)[(3/' <* /)(3cr)(W <* Fif))^uA^,b\fib'))]. 

Additionally, it is noted in [SJ §3] that conjunction can be given the following 
interpretation: 

(viii) ($ A = ((b^*** A '1'^'=*). 

Thus, let ip be internal and consider the following formula 

(st(j/) A-0(a;,y))'^"‘ = (?*c)[y <* cA'4’{x,y)], 

which yields that ((3?/)(st(y) A ip{x,y)))^‘'' is exactly 

(V'^*F)(?V)[(3/' <* /)(3y)(V6' <* F{f))[y <* /'(&') A j/)]]. (1.6) 

Take Fq and the associated /o as in (Irel) . and define cq := fo{Foifo))- Using the 
monotonicity of Fq and /o and the transitivity of <*, we obtain: 

((3y)(st(y) Ai/>(a;,j/)))^''‘ (3"*eo)(3?/<* eo)i/’(x, y). (1.7) 

For the reverse implication in (inD, for any monotone and standard F, take /, /' 
to be the function which is constant cq, the latter originating from the consequent 
of ()1.7F In this way, we obtain (jl.6l) and an equivalence in (jl.7L Next, note that 
[st(a:)]^'’‘ = (3®‘c)(a: <* c), and [st(a:) —)• (3y)(st(y) A i/^(a:, y))] is thus 

(V^V,d)(?‘&,eo)[(V&' <* b)ix <* m -A (3y <* eo)V'(cr,y))]. 

Finally, [(Vai)(st(x) —)• (3y)(st(y) A ^(x, y))] is the formula 

(V^V)(?‘&, eo)(Va;)[(V6' <* 6)(x <* /(&') ^ (3y <* eo)i^(a;, y))]. (1.8) 

Now take some standard and monotone xq of the same type as the variable x and 
apply m to /o, the constant Xq function. We obtain 

(V®*xo)(?*eo)(Va:)[(x <* xq (3y <* eo)i/’(a:, y))]. 


which is exactly as required, and we are done. 


□ 
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In light of the previous theorem, normal forms are invariant under Ust mod¬ 
ulo some extra appearances of the strong majorizability predicate. As noted in 
[HI § 2 ], objects of type zero and one are strongly majorisable, and are thus not 
affected (much) by the aforementioned addition of the strong majorizability predi¬ 
cate. Thus, it seems the results from m could also go through for M as long the 
standard variables in the normal form are of low type. We shah make this more 
precise in the following sections. 

Finally, as studied in [9j §4], the bounded functional interpretation by Ferreira 
and Oliva from m can be seen as a nonstandard interpretation where the non¬ 
standard part is concealed. 

1.3. Notations in M. In this section, we introduce notations relating to M. 

First of all, we use the same notations as in [H], some of which we repeat here. 

Remark 1.7 (Notations). We write (V®*a;'^)4)(a;'^) and (3®*x'^)'I'(a;'^) as short for 
(Vx"^) [st(a;'^) <i)(a;'^)] and (3®*a;'^) [st(a;'^) A'I'(a;'^)]. We also write (Va;° S 0)$(a;°) 

and (3a;° G 0)il'(a:°) as short for (Va;°) [-'St(a;°) —<i)(a;°)] and (3a:°) [-'St(a:°) A 
'I'(a;°)]. Furthermore, if -'St(x°) (resp. st(x°)), we also say that x° is hnhnite’ 
(resp. hnite) and write ‘x° G 11’. Finally, a formula A is ‘internal’ if it does not 
involve st, and A®* is dehned from A by appending ‘st’ to all quantihers (except 
bounded number quantihers). 

Secondly, we will use the usual notations for rational and real numbers and 
functions as introduced in [T5| p. 288-289] (and pH 1 . 8 . 1 ] for the former). We shall 
(sparingly) use the symbolic notation ‘R’ for the set of real numbers. 

Definition 1.8 (Real number). A (standard) real number x is a (standard) fast¬ 
converging Cauchy sequence i.e. (Vn°,i°)(|( 7 „ — qn+i)\ <o ^)- We freely make 
use of Kohlenbach’s ‘hat function’ from m p. 289] to guarantee that every sequence 
can be viewed as a real. We also use the notation [x]{k) := qk for the fc-th 
approximation of real numbers. Two reals x, y represented by <?(.) and r(.) are 
equal, denoted x =ir y, if (Vn)(|( 7 „ — r„| < ^). Inequality <ir is dehned similarly 
and the subscript IR is often omitted. Functions from reals to reals are represented 
by functionals such that 

(Vx\ i/^)(x =Ry ^ 4>(x) =R $(i/)), (RE) 

i.e. equal reals are mapped to equal reals. The property (EEI is abbreviated by 
$ : IR —>• R. We also write x ss y if (V®*n)(|g„ — r„| < ^) and x:^yifx>yAx 76 
y. Finally, sets are denoted ,Y^, . and are given by their characteristic 

functions fx, i.e. (Vx°)[x G X ga /x(x) = 1], where is assumed to be binary. 

Thirdly, we use the usual extensional notion of equality. 

Remark 1.9 (Equality). The system M includes equality between natural numbers 
‘=o’ as a primitive. Equality ‘=t’ for type r-objects x,y is then dehned as follows: 

[x = 1 - y] = (Vzp ... zl'‘)[xzi... Zk =0 yzi... Zk\ (1.9) 

if the type r is composed as r = (n t/c —>■ 0). In the spirit of Nonstandard 

Analysis, we dehne ‘approximate equality as follows: 

[x y] = (V’^^zp [xzi... Zk =0 yzi... Zk] 


( 1 . 10 ) 
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with the type r as above. All systems under consideration include the axiom of 
extensionality for all as follows: 

(yxP,yP)[x =py ^ p{x) =r <p{y)]. (E) 

However, as noted in [2 P- 1973], the so-called axiom of standard extensionality 
is problematic. The latter cannot be included in M for the same reason this 
axiom cannot be included in the systems from [2]. Finally, we always refer to lEEl 
from the previous remark as ‘extensionality on the reals’ to distinguish it from ©■ 

1.4. Non-standard Nonstandard Analysis in M. In this section, we prove 
some (mostly non-classical) basic theorems inside the system M. 

Theorem 1.10 (M). Every binary sequence is standard. The same holds for se¬ 
quences of binary sequences. Every sequence ot^ which is standard for standard 
index, i.e. (V®*n)(3®*TO)(Q;(n) = m), has a standard part, i.e. ssi fd). 

Proof. Every binary sequence by definition satisfies a <i 11..., and the latter 
implies a <* 11... by definition. As 11... is standard (which follows from the 
fact that all recursor constants are standard), the second basic axiom of M implies 
that a is also standard. Similarly, every sequence of binary sequences is majorized 
by the sequence of sequences which outputs 11... for every input. Finally, let 
be a sequence which is standard for standard indices. Define the (standard by the 
previous) binary sequence of sequences by /3(n, m) = 1 if a{n) = m, and zero 
otherwise. Now apply mAC^j to (V®‘n)(3®*m)/3(n,m) = 1 to obtain standard 
such that (V®*n)(3m < /(n))/3(n,m) = 1. It is now trivial to define the standard 
part of a using / and /3. □ 

Let WKL be the well-known weak Konig’s lemma (See e.g. [291 IV]). 

Corollary 1.11. The system M proves WKL’’*. 

Proof. Let T be any binary tree such that (V’’*n)(3a)(|al = nAa G T). By overflow 
(See Theorem I 1.1 5l or use minimisation), there is a binary sequence a of nonstandard 
length in T, and cr * 00 ... is standard by the theorem, i.e. the consequent of WKL”* 
follows for r. □ 

Corollary 1.12 (M). Every standard extensional type two functional is nonstan¬ 
dard uniformly continuous on Cantor space, i.e. (V</3^)(V/,g <i 1)(/ fVi g ^ 
fif) — same holds for any standard compact subspace of Baire space. 

Proof. The first part is immediate as the theorem implies that every binary sequence 
is standard. As a standard compact subspace of Baire space is given by {/* : / <i 
ho} for some fixed standard ho, the second part now follows in the same way as in 
the proof of the theorem. □ 

By way of example, every function on Cantor space which is continuous in the 
sense of Reverse Mathematics (See [23 11.6.2]) relative to ‘st’, is also standard 
extensional. 

By the previous results, it is cleai0 that M -|- n°-TRANS is inconsistent. The 
latter is a special case of Nelson’s axiom Transfer, and dehned as follows: 

(V”‘/*) [(V”‘n°)/(n) = 0 ^ (Vm)/(TO) = O] . (HO-TRANS) 

^Apply IIj-TRANS to oq 00 ... for oio{n) = 0 for n < M £ Q and 1 otherwise. 
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By [3l Cor. 12], nJ-TRANS is equivalent to the following ‘Turing jump functional’: 

(V)(V/)[(^(/) = 0 CA (3n)/(n) = 0], (32) 

Unsurprisingly, (32) is inconsistent with Kohlenbach’s uniform boundedness prin¬ 
ciples from [m §12], and M validates the latter principles as noted in [9l §1-2]. 

From the Reverse Mathematics of weak Konig’s lemma (See [29l IV]), we know 
that uniform continuity and the existence of an upper bound are equivalent (for 
continuous functions on a compact space). Thus, the following theorem should not 
come as such a surprise in light of Corollary 11.121 although there is no continuity 
requirement. 

Theorem 1.13 (M). Every standard yP' has a standard upper bound on Cantor 
space {or on any standard compact space). 

Proof. The axiom MAJ“j guarantees that every standard yP has a standard majo- 
rant, i.e. (y^^yP)(fP‘‘^'ilP){ip <2 ip)- By definition, the latter formula implies that 

(V’^V")(3^V")(V/' g){^{f) <0 m), 

and taking no = for <7o = H ■ • ■, we obtain f^ <1 !)(</?(/) <0 

no), which is exactly as required. □ 

Next, we prove a version of the Standard part principle for type two functionals. 
Define by b(/)(fc) = 0 if f{k) = 0 and 1 otherwise; We refer to V5(b(-)) as the 
restriction to Cantor space of (p2. 

Theorem 1.14 (M). Every type two functional restricted to Cantor space which 
maps standard binary sequences to standard numbers, is standard. 

Proof. For as in the theorem, we have (V/^)(3®*n)(:^(b(/)) < n), as every binary 
sequence is standard in M. Apply R“ to obtain a standard upper bound on (^(b(-)), 
say no. Then it is easy to verify that (^(b(-)) <2 ng, and since the latter constant 
function is standard, so is i^(b(-)) by the second basic axiom of M. □ 

Note that the previous result is classically false and much stronger than the 
Standard Part principle of 1ST. Combining with Theorem 11.131 every type two 
functional which does not attain infinite values on the standard part of Cantor 
space, has a standard upper bound. 

Finally, the system M proves the very useful overflow principle, which is not 
non-standard in nature. 

Theorem 1.15 (M). If (V®*a:'^)(p(a:) for internal (p, then there is a nonstandard 
y^ such that p{y). 

Proof. As noted in [51 §2], the axiom R“ implies the idealisation axiom. The latter 
is used in [2l Prop. 3.3] to prove overflow. □ 

2. Proof mining using M 

In this section, we establish two important features of the system M. First of 
all, we show that M allows us to extract computational information from proofs in 
Nonstandard Analysis, similar (but with significant modifications) to the results in 
m- Secondly, we show how the results from Section [1 .41 allow us to extract compu¬ 
tational information from proofs not involving Nonstandard Analysis, as explained 
in Section o 
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2.1. Mining a nonstandard proof. In this section, we study the statement CRI: 
A uniformly continuous function on the unit interval is Riemann integrable. We 
shall extract a proof of the effective version (HU from a proof of the nonstandard 
version HU of CRI inside M. In this way, we show that the techniques from m 
can work for the system M, with some non-trivial modification. 

The previous observation is highly relevant for us, as the extraction of compu¬ 
tational information from proofs and theorems not involving Nonstandard Analysis 
will still proceed by a detour via Nonstandard Analysis, as discussed in Sect ion [LTI 
and implemented in Section 12.21 

The relevant dehnitions of continuity and integration are as follows. 

Definition 2.1. [Continuity] A function / : IR —>■ IR is nonstandard continuous on 
[0,1] if 

(V"‘a; G [0, l])i'iy G [0, l])[a; y ^ f{x) Ki f{y)]. (2.1) 

A function / : IR —>■ IR is nonstandard uniformly continuous on [0,1] if 

(Vx, y G [0, l])[a; ^y^ f{x) f{y)]. (2.2) 

A function / : IR —> OR is uniformly continuous on [0,1] if 

(Vfc°)(3A°)(Va;\?/i G [0, l])[|a; - ?/| < jj ^ \ f{x) - f{y)\ < ^]. (2.3) 

A modulus of uniform continuity outputs iV° as in on input any fc® 

Definition 2.2. [Integration] For a partition tt = {0,to,xi,ti,... ,XM-i,tM-iA) 
of the unit interval (which we denote by tt G F([0,1])), the number S',r(/) := 
Sfco ^— Xi+i) is the Riemann sum and and ||7r|| is the mesh, i.e. the 
largest distance between two adjacent partition points Xi and Xi+i. A function 
/ : [R —> IR is nonstandard {Riemann) integrable on [0,1] if 

(VT,7r' G P([0, l]))[||7r||. Ill'll ^ 0 ^ 5.(/) « SM)], (2-4) 

A function / : IR —>■ IR is {Riemann) integrable on [0,1] if 

(VfcO)(37V)(V7r,7 r'GP([0 ,l]))[||7r||,||7r'|| < N ^ \S^{f) - SM)\ < i], (2-5) 

Let CRIns be the statement (V/ : IR — IR')[ p.2p — p.4p ]. define CRIef(t) as (11.211 . 

Theorem 2.3. From the proof of CRIpj in M a term t can be extracted such that 
E-PA‘^ proves CRIef(t). 

Proof. For completeness, we first show that CRI ns can be proved in M. A similar 
proof may be found in [ISJHT] . 

Given two partitions of the unit interval tt = (0, to, xi,ti,..., Xm-iAm-i, 1) and 
tt' = {0,to,x'i,t'i,... ,x'j^,_i,tM'-iA) with infinitesimal mesh, let x'f for i < M" 
be an enumeratior0 of all Xi and cc' in increasing order. Let t'f and t'f' for i < M" 


^To make this enumeration effective, work with the approximations [xi](2^) and [x{](2^ ) 
and note that the difference is infinitesimal in the below steps. 
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be the associated ti and t" with repetitions (corresponding to x") of the latter to 
obtain a list of length M" . Then we have that 

l^.(/) - s^,U)\ = I E^o' - ^*+i) - - <+i)\ 

= I E^^E' /(in« - EVi) - E^^E' /(E)(E - ^Ei)l 
= IE^E'(/(E)-/(E))-(E-^Ei)l 
< E^E' l/(E) - /(E)l • IE - ^Eil < E^E' • IE - x'Vil« 

where Cq := inaxj<M" |/(^n “ /(^Dl i® infinitesimal due to the (uniform non¬ 
standard) continuity of / and the definition of tt, tt'. 

Hence, we obtain CRIns inside M, from which we now derive CRbi(t). To this end, 
we show that CRIns can be brought into the normal form for applying Corollarv ll.61 
First of all, we resolve in the antecedent of CRIps as follows: 

(Vx,y e [0,l])[(V"*A^)|x-y| < ^ ^ (V"*fc)l/(E -/(y)l < il- (2-6) 

Bringing all standard quantifiers in (12.61) outside the square brackets, we obtain: 

(V"*fc)(Vx,y e [0,l])(3"‘fV)[|x -2/1 < ^ l/(E -/(y)l < il- (2-7) 

Since the formula in square brackets in (12.7p is internal, we apply R*^ and obtain 
{y^^k){3^^N'){\fx,y e [0,l])(3fV <* N')[\x-y\ < ^ ^ |/(E -/(El < il- (2.8) 

By definition, <q is just <o, implying 

(V^‘fc)(3^*A')[(Vx,2/ e [0,l])[|x-2/| < ^ ^ l/(E - /(El < il]. (2.9) 

Since the formula in (big) square brackets is internal, we may apply rnAC^^ and 
obtain a standard and monotone such that: 

(V^‘A:)(3iV <* g{k)) [(Vx, y G [0, l])[|x - 2/| < ^ ^ |/(E - /(El < il] ■ (2.10) 

Again using that <q is <o, we obtain 

(V"*E [(Va;, y G [0, i])[|x - 2/1 < ^ ^ l/(E - /(El < il], ( 2 . 11 ) 

i.e. (? is a modulus of continuity for /. Similarly, the consequent of CRIps yields: 

{y^^k'){3^^N')[{y7Ty G P([0,l]))(||7r||,E'|| < ^ ^ |E(/)-E(/)| < M (2-12) 

where B{k', N', f) is the (internal) formula in square brackets; Let A{g, k, f) be the 
(internal) formula in big square brackets in (I2.11|) . Then CRIps implies 

(EE, k')(yf)(3^^N', k)[Aig, k, /) ^ B{k', N', /)], (2.13) 

in which the formula in square brackets is internal again. Note that we may omit the 
limitation to monotone g, since (12.111) also implies (12.61) without this monotonicity 
assumption. Thus, we obtain 

(y^g, k')(yf)yy, k)[Aig, k, /) ^ By, n', /)], ( 2 . 14 ) 

Applying R”^ to (12.141) . we obtain 

y^g,k')yH)(yf)i3N',k y i)[A{g,k, /) ^ By, n', /)], ( 2 . 15 ) 

which yields, by the special structure of B and the definition of <q, that: 

(V^E, fc')(3^‘fV')(V/)(3fc) [41(27, k, f) ^ By, N', /)]. 


( 2 . 16 ) 
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Applying Corollarv ll.BI to (I2.16|l . the system E-PA"^ proves 

{yg,k'){Vgo,k'o <* g,k'){3N' <* t{go,k'o)){Vf ){3k)[A{go,kJ) ^ , iV',/)], 

for some term t from the original language. For a sequence g^, define the corre¬ 
sponding monotone g by g{k) := max„<fc g{n) and note that g <* g. Since <o is 
just < 0 , the previous yields: 

(V/, 5 )[(VA:)A( 5 ,fc,/) ^ {'ikW,t{g,k')J)], (2.17) 

which is exactly CRIgf (u) for u{g, k') = t{g, k') by the definitions of A and B. □ 

Note that the actual computation in CRIef(t) only takes place on the modulus. 
Thanks to the previous theorem, we can define (inside E-PA“) the Riemann integral 
functional l{f,0,x) which takes as input a continuous function / on [0,1] and 
outputs f{t)dt. In particular, [/(/, 0, a:)](fc) is defined as J2i=o fiw'tw 
i{x) is the least partition point larger than x. To guarantee that /(/, 0,a:) converges 
‘fast enough’, one considers [l{f,0,x)](t{g,k)) where g is a modulus of uniform 
continuity of / and t is the term from Theorem 12.31 


2.2. Mining a standard proof. In this section, we treat the fundamental theo¬ 
rem of calculus (denoted FTC; See [531 §6]), which states that differentiability and 
integration cancel each other out. 

We shall obtain a proof of the effective version (12.191) of FTC from a proof of 
the latter in ‘standard’ mathematics, i.e. not involving Nonstandard Analysis. We 
shall accomplish this by taking the following ‘detour’ into Nonstandard Analysis: 
We prove in M that the ‘usual’ e-J-definition (of continuity, differentiability, et 
cetera) relative to ‘st’, is equivalent to the associated nonstandard definition. In 
this way, we observe that FTC’*” implies a nonstandard version of FTC, namely 
(12.251) below. To the latter, we apply the ‘term extraction’ techniques from the 
previous section to obtain the effective version (|2.19|) of FTC. 

The previous paragraph highlights an advantage of M over the systems from 
[2] , namely that we can extract information from proofs not involving Nonstandard 
Analysis. By contrast, the systems from |2] were used in |27j to extract effective ver¬ 
sions from proofs in Nonstandard Analysis. More examples are studied in Section|4j 
while a general template is introduced in Section 12.31 


We first study the first part of FTC which states that F'{x) = f{x) for continuous 
/ such that F{x) := f{x)dx; We shall consider the following ‘usual’ version of 
FTC, which states that for all and / : IR —>■ R, we have 


(Vfc')(3iV')(Vx, y e [0, l])(|x - 2/1 < ^ \f{x) - f{y)\ < p] 

(Vfc)(3iV)(V£)(Vx G [i,l - i])[e < A ^ |Ag(/(/,0,x)) - /(a:)! < i], (2.18) 

where Ag{f{x)) := ^ effective version FTCef(t) is the statement 

(V/, g, 1) (Vx, y G [0, l],k'){\x -y\< ^ \fix) - f{y)\ < p] ^ (2.19) 

(Vfc)(ViV > t{g,kJlx€ [i, 1 - i]) [|A 1 (/(/,0,ai)) - fix)\ < 


Note that Kohlenbach has shown that continuous real-valued functions as repre¬ 
sented in Reverse Mathematics (See [29l 11.6.6] and [Ml Prop. 4.4]) automatically 
have a modulus of pointwise continuity. The same construction works for uniformly 
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continuous functions and the associated modulus of uniform continuity. Hence, the 
antecedent of FTCef(t) is still quite natural. 

Theorem 2.4. From the proof of (12.181) in E-PA"^, a term t can be extracted such 
that E-PA"^ proves FTCef(t). 

Proof. It is straightforward to prove (12.181) inside E-PA*^; It is then easjQ to verify 
that M proves (12.181) ^* for any / : [R —>■ OR and standard We now derive the 
nonstandard definitions of (uniform) continuity and differentiability from the usual 
c-(5-definitions relative to ‘st’ in M. 

First of all, working in M, the definition of uniform e-d-continuity relative to ‘st’ 
implies the following: 

where r( 7 ) := Replace the predicates ‘<C’ by ‘<’ to obtain 

By Theorem ll.lOl every binary sequence is standard in M, hence 
(W‘A:')(3^*A^')(Va\/3i <i l)(|r(a)-r(/3)| < ^ ^ |/(r(a))-/(r(/3))| < ^]. (2.20) 

Recall that the classical fact every real number has a binary expansion, can be 
proved in RCAq, a weak system of second-order arithmetic ([IS])- Furthermore, the 
definition of / : IR —>■ IR as in Definition 11.81 is such that for a real x and its binary 
expansion a, we have f{x) =ir /(c(a)) as x =ir r(a). Hence, p.20p becomes: 

(W*A:')(3^*iV')[(Vx,2/ e [0, l])(|x - i/| < ^ ^ |/(a:) - f{y)\ < i)], (2.21) 

which also implies that / is nonstandard uniformly continuous. Thus, we proved 
that continuity as in (I2.3I) ’‘* implies nonstandard continuity for any / : [R —>■ IR. 

Secondly, we can similarly prove that for standard I, the consequent of (12.1811 
relative to ‘st’, i.e. 

(W‘fc)(3«*7V)(W‘£,a: e [j, 1 - i])[0 ^ ^ ^ |A,(/(/, 0, ai)) - /(a:)| « i], 

(2.22) 

implies the following two nonstandard versions: 

(Wtfc)(3^‘iV)[(Ve,x G [i,l-i])(0 |A,(/(/, 0, x))-/(x)| < i)], (2.23) 

{Ve){Vx G [i, 1 - i]) [0 ^ e 0 ^ l^eiHf, 0, x)) - /(x)| « 0], (2.24) 

where the latter is just the consequent of (12.1811 formulated with the nonstandard 
definition of differentiability. The formula (12.241) is easily seen to yield (I2.23P in the 
same way as in the proof of Theorem 12.31 namely resolve ‘ss’ and use to bring 
all standard quantifiers outside. 

Finally, putting the previous together, the proof of (I2.18|) ^* (for any / : IR —>• R 
and standard 1°) yields 

(V/ : [R ^ 1R)(V’’*0 [{Y^k'){3^^N')A{k', N', f) (V"*fc)(3"* A)H(fc, N, /)], (2.25) 

where A (resp. B) is the square-bracketed in (12.211) (resp. (12.231) '). In the same 
way as in the proof of Theorem 12.31 one now brings p.25|l into normal form, and 
applying Corollary 11.61 yields FTCef(t), and we are done. □ 

^The original proof actually goes through verbatim relative to ‘st’, as standard extensionality 
follows from e-^-continuity relative to ‘st’. 
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Note that it is essential for the proof of the theorem that / is extensional for real 
numbers as in m- Indeed, the latter allows one to to pass from (12.2011 to (12.2111 
via binary representations. Furthermore, while every binary sequence is standard 
in M, the latter only implies that every real number equals (in the sense of =ir) a 
standard number, but not that every real number is standard. Finally, it would be 
interesting to compare the complexity of the term from the previous theorem and 
the term extracted from the ‘nonstandard’ proof in [23 §3.3.3]. 

In the following remark, we point out that the second part of FTC as formulated 
in [231 Theorem 6.21] can be treated similarly. 


Remark 2.5 (Second part of FTC). The nonstandard, non-effective, and effec¬ 
tive versions of the second part of FTC are as follows, using the same notion of 
differentiability as above. 


(V/)(V^*fc) (Ve,e' 


0)(Vx e [-1 1 + i])[Ae(/(a:)) AAfix))] ^ 


(Ve > 0) [e 0 ^ /(Ae(/(-)), 1)) « /(I) - /(O)] 


(2.26) 


(V/,A) (V0(3A)(Vc,e' < i)(Vx G [-i,l + i])[lA,(/(x)) - AAf{x))\ < }] 




(Vfc)(37V)(Vc > 0) [£ < i ^ |/(Ae(/(-)), 1)) - (/(I) - /(0))| < i] 


{Vf,g,k) (V0(Ve,e' < ^)(Va: G [-i, 1-F ^])[lAe(/(a:)) - Ae/(/(x))l < j] 


(Vfc)(V£ > 0) [e < ^ |/(A,(/(-)), 1)) - (/(I) - /(0))1 < i] 


The effective version is obtained from the non-effective version via the nonstandard 
version by applying the same steps as in the proof of Theorem 12.41 Note that 
the notion of differentiability used in (|2.26|) gives rise to Bishop’s definition |3 
Definition 5.1, p. 44]. In particular, it is easy to verify that we would obtain: 

(3^‘5)(V^‘0(V£,e' > 0)(Vx G [-i,l+i])[l£l, ]£'] < ^ ^ \A,{fix))-AAf{x))\ < j] 


in the former case, i.e. a modulus of differentiability naturally emerges. 


The inquisitive reader has no doubt noted that by the previous proof, M also 
proves that a pointwise (nonstandard or e-S relative to ‘st’) continuous function is 
uniformly nonstandard continuous, and therefore nonstandard Riemann integrable 
by the results in the previous section. In Section |3T] we show that this fact does 
not contradict [29l IV.2.7], which states that weak Konig’s lemma (not available in 
E-PA“) is equivalent to the fact that a pointwise continuous function is Riemann 
integrable on the unit interval. 


2.3. General template. In this section, we provide a general template for extract¬ 
ing computational information from a proof not involving Nonstandard Analysis. 
We will limit ourselves to a theorem T with a proof in E-PA‘‘’-f WKL. The motivation 
for the latter limitation is discussed at the end of this section. 

(1) First of all, verify that E-PA‘^ + WKL h T implies that M h T in light of 
Corollary II. I II 

(2) Secondly, verify that the e-5-definitions (of continuity, differentiability, etc) 
relative to ‘st’, are equivalent to their nonstandard versions in M; Let T* 
be with the former replaced by the latter. 
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(3) Thirdly, the definitions of common notions (such as continuity, differentia¬ 
bility etc) in Nonstandard Analysis can be brought into the ‘normal form’ 
{\/‘^^x)(BP^y)(p{x,y), where ip is internal, i.e. does not involve ‘st’. This can 
always be done in M. 

(4) Fourth, the aforementioned ‘normal form’ is closed under modes ponens: 
Indeed, it is not difficult to show that an implication of the form: 

(V"‘a;o)(3"‘j/o)</?o(a:o,2/o) yi), 

can also be brought into the normal form (V®*x)(3®*y)(/5(x,y). Hence, T* 
can be brought into normal form inside M. 

(5) Fifth, the normal form of T*, say (V®*a;)(3®*y)(/:(a;, y), has exactly the right 
structure to yield the effective version of T, namely {\/x)(p{x,t{x)). In 
particular, we can apply Corollary 11.61 to the proof of the normal form 
(V®*a;)(3®*y)(^(a:, y) inside M. If x and y are of low enough type, the ma- 
jorizability predicates ‘<*’ disappear, and we obtain {ix)ip{x,t{x)). 

In Section [HI we establish some limitations to the scope of the previous sketch. As 
will become clear, we should limit ourselves to theorems provable in E-PA*^ -f WKL 
concerning uniform notions (of continuity, differentiability, et cetera). The latter 
limitation is also suggested by the final step. 

In Section r4.ll we apply the above template to theorems concerning convergence. 
In Section 14.21 we show how to extend our template to obtain approximations to 
objects stated to exist by (classical and ineffective) higher-order existence state¬ 
ments. Finally, in Section [4.31 we discuss a more general framework for the second 
step of the above template, namely the equivalence between the ‘usual’ and non¬ 
standard definitions of mathematical notions, and apply it to the notion of open 
set and related notions. 


3. Limitations of M 

In the previous section, we discovered an advantage of M over the systems from 
[2] , namely that M may be used to extract computational information from standard 
proofs, i.e. not involving Nonstandard Analysis. In this section, we discuss three 
disadvantages of M compared to the systems from [2]. 

3.1. Pointwise versus uniform definitions. In this section, we show that for 
our purposes M is not suitable for studying theorems involving pointwise definitions 
(of e.g. continuity, differentiability, convergence, et cetera). In particular, we show 
that Ust converts the pointwise definition of (nonstandard) continuity into uniform 
continuity. Hence, while we can prove theorems concerning pointwise continuity 
in M, the term extraction theorem [Theorem 11.5|1 converts them into theorems 
concerning uniform continuity anyway. Analogous results for differentiability and 
convergence are immediate. 

Furthermore, pointwise nonstandard continuity (and convergence, differentiabil¬ 
ity, et cetera) involves a leading standard universal quantifier, and we shall obtain 
dual results for standard existential quantifiers. In particular, we show that Ust 
converts the latter to the existence of rather trivial upper bounds in the case of real 
numbers and other higher-type objects. 
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First of all, we establish that M proves CRI^^, where the latter is just CRhs 
from Section [23] but with nonstandard pointwise continuity (instead of the uniform 
version (ES) as follows: 

(V"‘a: G [0, G [0, l])[a: y ^ f{x) Ki f{y)]. (3.1) 

As in the proof of Theorem 12.41 we note that every real equals a standard real 
(given by a standard binary expansion). Hence, the leading ‘st’ in (13.111 may be 
dropped, and M h CRIns now yields M h CRl)^. Repeating the proof of Theorem l2.3l 
for the latter proof, we obtain that E-PA*^ proves 

(yx,yG [0, l],fc)(|a; -?/| < |/(x) - fiy)\ < (3.2) 

^ (V7r,7r' G P([0,l]),n)(||7r||, IItt'II < - S^(f)l < i) 

As always, the devil is in the detail: We require the existence of a monotone modulus 
(of pointwise continuity) g in (13.21) . Now, the dehnition of g{-, k) <2 g{-, k) for hxed 
k is as follows: 

(yx^,y^){{Wn)x{n) <0 y(n) g(x, k) <0 g{y, k)), (3.3) 

i.e. g{-,k) is weakly increasing for weakly increasing input. Now suppose the real 
numbers x,y in (13.21) are represented by binary sequences as follows: 

(V/Mii, fc)(|r(b(/)) - r(b(h))| < ^ ^ l/(r(b(/))) - /(r(b(/i)))| < i), (3.4) 

where r is as in the previous section and b(/)(fc) := 0 if /(fc) = 0 and 1 otherwise. 

Then if g is monotone, the associated version of dSSl) yields that g(ll...,-) is 
a modulus of uniform continuity for /. In other words, a monotone modulus of 
pointwise continuity is just a modulus of uniform continuity in disguise. Hence, 
the interpretation Ust translates pointwise nonstandard continuity (occurring in 
the antecedent) into uniform continuity, and the resulting formula (13.21) is nothing 
more than m in disguise. 

Secondly, if pointwise (nonstandard) continuity (13.ip occurs positively in a the¬ 
orem of M, then it gets translated by Ust to 

(VA:)(Va;)(Va:',y G [0, l])(a;' <* xA\x-y\< ~ < i). 

where t is a term form the internal language, depending on the other (standard) vari¬ 
ables in the theorem at hand. Using binary representation as in (13.4p . we note that 
t provides a modulus of uniform continuity in exactly the same way. Note that the 
reason why we obtain uniform dehnitions (of continuity, differentiability et cetera) 
from Ust and Corollary 11.61 is that the latter introduces majorizability predicates 
in such a way that a standard universal quantiher gives rise to (Va;)(Va;' <* x)... 
and the bound for the associated existential quantiher only depends on x, not x'. 

Thus, we have shown that pointwise dehnitions (of continuity, convergence, ...) 
are translated to uniform dehnitions by Ust- In other words, it does not seem to 
make much sense for our purposes to study theorems involving these pointwise no¬ 
tions using M. Now, nonstandard pointwise dehnitions involve a leading standard 
universal quantihers, and the previous results ‘dually’ imply that standard exis¬ 
tential quantihers only result in an upper bound (in terms of majorization) when 
interpreted by Ust- For real numbers and other higher-type objects, this upper 
bound provides little information, as illustrated by the following example. 


(V/ : R ^ R)(Vg) 
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Example 3.1. Assume M can prove a version of the intermediate value theorem 
where G [0,l])(/(a;) = 0). Now, applying Corollary 11.61 to the latter only 

provides a term t such that (3a; G [0,l])(x <* t{...) A f{x) = 0). Moreover, 
if we use binary representation as follows: (3®*a^)(/(r(b(a))) = 0), the associated 
upper bound for a can be 11... (which provides no information), or 00 ... 0011..., 
(which only provides an approximation with fixed precision). Note that there is 
an approximate version of the intermediate value theorem with arbitrary precision 
(See [HI §2.4.8]) in Constructive Analysis. 

The previous example should not come as a surprise: Kohlenbach has shown 
that a functional computing the intermediate value of a continuous function, also 
computes the Turing jump ([lU Prop. 3.14]). Moreover, the interpretation Sst 
from [2] has a similar feature: The statement (3®*x^ G [0, l])(/(x) = 0) would be 
translated into (3x^ G t(... ))(x G [0,1] A /(x) = 0), where t is a term from the 
language which provides a finite sequence of witnesses. Clearly, this finite sequence 
does not provide much information about the actual fixed point. 

In conclusion, we should limit our scope to theorems involving uniform defini¬ 
tions (of continuity, differentiability, convergence, et cetera) and avoid existence 
statements involving standard higher-type objects. Nonetheless, we establish in 
Section that M may be used to obtain approximations to objects claimed to 
exist by existential statements, using nothing more than a classical proof of the 
latter. 

3.2. Theorems implying arithmetical comprehension. In this section, we 
study the suitability of M for the extraction of computational information from 
theorems implying (the nonstandard version of) arithmetical comprehension. In 
particular, we show that the approach from |261I27] does not work, thereby expos¬ 
ing another disadvantage of M. 

In more detail, explici10 equivalences involving arithmetical comprehension (3^) 
are obtained in EH §4.1] and [55] as follows: For internal (p, the equivalence 
nj’-TRANS G)- {y^^x){3‘^^y)tp{x,y) is brought into normal form, and term extrac¬ 
tion is applied to obtain terms s, u validating the following explicit implications: 

(V^^)[MU(^) —>■ (Vx)i^(x, s(^))] A (Vt)[(Vx)(^(x,t(x)) —> MU('u(t))], (3.5) 

where MU(/x) is the formula in square brackets in the following formula 

(3^1^) [(V/i)((3n)/(n) = 0 ^ f{y{f)) = 0)], 

which is also called Feferman’s non-constructive search operator and is equivalent 
to (3^) by [TS] Prop. 3.9]. By way of example, the results in [2^ suggest that all 
theorems from the Reverse Mathematics zoo (III) can be classified as in (I33|). 

The technique sketched just now involving IlJ-TRANS behaves as follows in M. 

Theorem 3.2. For internal (f, applying Corollary 1 1. 61 to M h IlJ-TRANS —> 
(V®‘x°)(3®*?/°)i^(x, y) yields a term t such that E-PA"^ h (V/r)(MU(/r) -A (Vx)(/3(x, t(x, y))). 


®An implication (3<I>)A($) —>■ (3'I')i3('I') is explicit if there is a term t in the language such 
that additionally (V$)[A($) S(t($))], i.e. 'If can be explicitly defined in terms of 
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Proof. Note that II^-TRANS has the following normal form: 

(V^Vi)(3^‘n)[(3m)/(m) = 0 ^ (3* < n)/(*) = 0], 
and hence the assumption of the theorem implies that M proves 

(V"V^ [[(3m)/(m) = 0 ^ (di < n{f))f{i) = 0] ^ ip(x, y)], 

and applying Corollary II.61 finishes the proof. □ 

By the previous theorem, Ust translates II^-TRANS into the existence of a mono¬ 
tone non-constructive search operator, which however does not exist. Indeed, the 
proof of m Prop. 3.70] implies that (/i^) is not even majorisable. In other words, 
the final formula in Theorem l3.2l is vacuously true. 

In conclusion, we observe that the approach from [53 §4.1] does not work in M. 
The same holds mutatis mutandi for the reverse implicatioifl ... —> IlJ-TRANS, and 
the results pertaining to n]-comprehension (and the Suslin functional) in |271 §4.5]. 

Finally, any functional computing the intermediate value (or the maximum) of a 
continuous function on the unit interval, also computes the Turing jump functional 
(3^) (See [13 §3]). While the results in this section imply that we cannot study 
the former functional in M, we shall obtain approximate results in Section [4.21 

3.3. System M and the fan functional. In Section IXTl we showed that for our 
purposes the study of pointwise notions (of e.g. continuity) in M is not very useful. 
In this section, we willy-nilly attempt this study, and in the process obtain a ‘no 
go theorem’ similar to Theorem 13.21 at the level of weak Konig’s lemma. 

Now, the study of pointwise notions is indeed tempting, as discussed now. 

Remark 3.3 (Dini’s theorem and the fan functional). First of all, Dini’s theo¬ 
rem is the statement that a monotone sequence of continuous functions converging 
pointwise to a continuous function on a compact space, also converges uniformly 
(See e.g. [53) Theorem 7.13, p. 150]). Following [3], Dini’s theorem is equivalent 
to weak Konig’s lemma in classical Reverse Mathematics. Note that this lemma 
states the existence of non-computable objects. 

Secondly, Dini’s theorem was studied in [271 §4.3], resulting in a term t which 
constitutes a modulus of uniform convergence, taking as input the moduli of (point- 
wise) continuity and (pointwise) convergence and the fan functional. The latter 
provides a modulus of uniform continuity for (pointwise) continuous functionals on 
Cantor space (See [53 §4] and (13.61) below). Serendipitously, the fan functional has 
a computable representation, called a recursive associate (See [53 Theorem 4.2.6]), 
implemented in Haskell ([S])- 

Thirdly, all terms in Godel’s T have canonical interpretations in the typed struc¬ 
ture of the Kleene-Kreisel countable functionals (See [221 §2] for the latter) and this 
interpretation provides canonical associates. Thus, in Kleene’s second model (See 
e-g- [B §7-4, p. 132]), for a term t of Godel’s T and $ the fan functional, t(<I>) can 
be computed by evaluating the associate for t on the associate for $. 


®Note that the term provided by CoroIIarv ll.6l is also monotone, which would also result in a 
monotone search operator in the second conjunct of iS.SII . 
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The previous remark suggests that we may extract information which is com¬ 
putable modulo the fan functional from theorems implying weak Konig’s lemma. 
Although the latter states the existence of non-computable objects, there is a tech¬ 
nical way of computing values of the fan functional, i.e. the obtained computational 
information does not ‘really’ depend on a non-computable oracle. 

We now show that the approach sketched in the previous remark does not work 
in M. To this end, recall that the fan functional is dehned as: 

e c)[{'if,g <1 i)(f^{^) =0 g^{^) ^{f) =0 (3.6) 

where the formula in square brackets is denoted MUC(r2). We also define MUCns as 

(WV" e C)(V/, g <1 !)(/ g ^ V’{/) = V’(ff))- (3-7) 

Note that is assumed to be pointwise continuous. 

Theorem 3.4. For internal tp, applying Corollaru \1.6\ to 

M h [MUCns ^ y)] (3.8) 

yields a term t such that E-PA“ h (Vf2)(MUC(r2) —>■ {yx)ip{x,t{x,fl))). 

Proof. Clearly, (1X711 implies (using classical logic) that 

(WV')(V/,5 <1 l)(3^‘iV°)(V’ €CAjN = gN^ i/-(/) = i/;(g)), 

and applying R“ yields 

(Vst^ 2 )(gst^ 0 ) g <, & C AJN = gN ^ V’(/) = V’(ff))] , 

where A(^,iV) is the formula in square brackets. ThenMUCps —>■ (V®*a:°)(3®*2/°)(^(x, y) 
implies the following normal form: 

and the theorem follows. □ 


By the previous theorem, C/gt translates MUCns into the existence of a monotone 
fan functional, which however does not exist] Indeed, as noted in |101 p. 42], the 
fan functional is not even majorisable, and we observe that (13.811 gives rise to a 
vacuously true statement. This problem remains when one replaces MUCns in (13.811 
by other nonstandard principles implying weak Konig’s lemma, as we show now. 
In particular, we consider the Standard part principle for Cantor space 

(Va^ <1 l)(3«*/3 <1 l)(a /3), (STP) 

which is easily seen to imply weak Kdnig’s lemma relative to ‘st’. 


Corollary 3.5. For internal p, applying Corollary \1.6\ to 

M + QF-ACi’° h JSTP]^ (W*a;°)(3"‘j/°)‘P(a;,2/)] 
yields a vacuous truth. 

Proof. First of all. ISTPl is (easily seen to be) equivalent to the following: 
(VT^ <1 l)[(V"‘ai <1 l)(3"‘n°)(an^T) 

^ (3"*fc°)(W*/li <1 l)(3i < k)(pi T)], 


(3.9) 


(3.10) 
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in which one immediately recognises the fan theorem, i.e. the classical contraposi¬ 
tion of weak Konig’s lemma. Now, (jS.lOll is equivalent to the normal form: 

a)(75(7) (3.11) 

^(V /31 <1 l)(3*<fc)(^*^T)]], 

where B{g,k,a) is the formula in outermost square brackets. Hence, (13.91) implies 

M h (V^‘x°,S)(3^‘y°)[(V5^)H(g,5(5)(l),S(g)(2)) ^ ^{x,y)], 

and applying Corollary II.61 yields a term such that E-PA"^ proves 

(Va:°, S)(Vx', S' <* x, E){3y° <* t(S, x)) [(yg^)B{g, S(g)(l), S(5)(2)) ^ ip{x, y )], 

(3.12) 

Now suppose S is a monotone functional satisfying {'ig‘^)B{g,^{g){l),^{g){2)). If 
is such that (Va^ <1 l){ah{a) ^ T), then the binary tree T is not taller than 
S(h)(l). In other words, we obtain the following explicit version of the fan theorem 

(V/i2)[(Vri <1 1)[(V7 <1 l){lh{^)^T) (3.13) 

^(V^i <1 i)(3*<s(h)(i))(^*^r)]], 

noting that S(-)(l) is also monotone. Clearly, (|3.13p implies weak Konig’s lemma 
assuming QF-AC^’°. By the results in [ini §4], weak Konig’s lemma implies that 
every G C has a so-called associate a^, i.e. we have 

(1) (V/3i)(3iVO)_(a(^iV) > 0). 

(2) (VM,/3)(a(/3M) > 0 ^ (/j(/ 3) -f 1 = a(/3M)). 

The reduction in quantifier complexity afforded by associates (rather than the usual 
definition of continuity), allows us to define a tree as follows: cr G Tq, CA a(cr) = 0 
where a is an associate for ip € C. Hence, we may conclude that S as in (13.1311 
is ‘almost’ the fan functional in that it works on associates of functionals (rather 
than the functionals themselves). However, since every ip € C has an associate 
(thanks to weak Konig’s lemma), the functional S cannot be majorisable (let alone 
monotone), and we obtain that (13.121) is a vacuous truth. □ 

Finally, we show that while Theorem 11.131 already is in normal form, it does 
not yield a ‘supremum functional’ as one would perhaps hope (or fear, as such a 
functional is not available in E-PA'^). 

Corollary 3.6. Applying Corollary \1.6\ to Theorem \l.lSl we obtain a triviality. 

Proof. X □ 

In conclusion, we have established that the approach from [23 §4] involving the 
fan functional (and certain variations) does not work in M. 

4. Proof mining using M bis 

In this section, we provide more examples of how to extract computational in¬ 
formation from proofs not involving Nonstandard Analysis. In particular, we show 
in Section 10 that from certain classical and ineffective existence proofs, one can 
‘automatically’ extract approximations to the objects claimed to exist. We show 
that if the object claimed to exist is unique, the approximation converges to it. 
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4.1. Theorems involving convergence. In this section, we show how the tem¬ 
plate sketched in Section 12.31 may be used to extract computational information 
from theorems involving convergence. 

First of all, we study the uniform limit theorem (See [201 Theorem 21.6]), which 
states that if a sequence of continuous functions uniformly converges to another 
function, the latter is also continuous. In light of Section 13.11 we shall study the 
uniformly continuous case; We will extract the effective version from a proof not 
involving Nonstandard Analysis. Nonstandard convergence is defined as follows. 

Definition 4.1. A sequence Xn nonstandard converges to x if (VA^ S 11) (a; « 
xn)- a sequence fn{x) nonstandard uniformly converges to f{x) on [0,1] if (Vx € 
[0,l],lVGll)(/v(a;)«/(a;)). 

Hence, we have the following nonstandard version. 

Theorem 4.2. For all fn, / : IR —>■ R, we have 

[(V’'*n°)(Va;\ 2 /^ G [0, l])[x ^ y ^ fnix) ~/„(?/)] A (ULCps) 

(Vx G [0,1])(V7V G H)(/v(x) ss f{x))] (Vx G [0, l])(Va;, y G [0, l])(a; y ^ f{x) « f{y)). 

Let U LC denote the statement that a sequence of uniformly continuous functions 
uniformly converges to another function, the latter is also uniformly continuous. 

Let C{f,g,S) be the statement that / is uniformly continuous on S with modulus 
g and let D{fn, /, h, S) be the statement that /i is a modulus of uniform convergence 
for /„—>•/ on S, i.e. h does not depend on the choice of point in S. Let ULCef(t) 
denote the statement that for all /, /„ : IR —>• R, and h^ we have 

[(Vn°)C(/„, g„, [0,1]) A D(/„, /, h, [0,1])] ^ C(/, t(g„, h), [0,1]). (4.1) 

We have the following theorem. 

Theorem 4.3. From a proof of ULC in E-PA"^, a term t can be extracted such that 
E-PA"^ proves ULCef(t). 

Proof. First of all, it is straightforward to prove ULC inside E-PA"^, yielding a proof 
of ULC’** in M. To obtain ULCns from this standard statement, strengthen the 
antecedent to nonstandard uniform continuity and convergence (which is trivial) 
and strengthen the consequent to nonstandard uniform continuity (in the same way 
as for Theorem l2.4|) . 

Secondly, for completeness, we directly prove ULCns in M. To this end, let 
/ and fn be as in the antecedent of ULCns. Now hx standard x,oyo G [0,1] 
such that Xq ~ yo- By assumption, we have (V’**n)(/„(a;o) ~ fn(i/o)), implying 
(V^*n, k)(lfn(xo) — /n(yo)| < -I)- By overflow (See Section [L4ll . there is A^o C ^ 
such that {yn,k < No){\fn{xo) — fn{yo)\ < ^)- Again by assumption, we have 
/(xo) ~ fNoixo) ~ fNoiyo) ~ f{yo), which implies the nonstandard uniform conti¬ 
nuity of /. Alternatively, ULCns can be proved in E-PA“^. by proving overflow using 
induction rather than idealisation. 

Thirdly, we show that ULCns can be brought into the right normal form for 
applying Corollarv ll.6l Making explicit all standard quantifiers in the first conjunct 
in the antecedent of ULCps, we obtain: 

(W‘n°)(Vxi,yi G [0,l])[(W‘7V)|x-y| < ^ ^ (V^‘fc)|/„(x) -/„(!/)| < i] 


THE COMPUTATIONAL CONTENT OF STANDARD MATHEMATICS 


21 


Bringing the standard quantifiers to the front as much possible, this becomes 
(V"*nO,fcO)(Va;\i/i € [0, l])(3"‘7V)[|x - y| < ^ -t \ fn{x) - fn{y)\ < il- 
Since the formula in square brackets is internal, we may apply R“ to obtain 
(V’'*n°, e [0, l])(3iV < m)[\x - y\ < jj ^ \ fn{x) - /„(y)| < -j], 

which immediately yields 

(V"‘n°,fc°)(3"*mO)(Vx\l/l S [0, l])[|x - ?/| < ^ \fn{x) - fn{y)\ < 

Now apply mAC^t to obtain 

e [0,l])[|a;-?/| < \fn{x) - fn{y)\ < i]]. 

For brevity let ^(•) be the formula in big square brackets. Similarly, the second 
conjunct of the antecedent of ULCns yields 

[(Vx G [0,1])(V7V > h{x, mif^ix) - f{x)\ < i)], 

where B{-) is the formula in big square brackets. Lastly, the consequent of ULCns, 
which is just the nonstandard uniform continuity of /, implies 

(V^‘fc)(3«*lV)[(Vxi,2/G [ 0 ,l])(|ai- 2 /| < ^ ^ \f{x)-f{y)\ < i)], 

where E{-) is the formula in big square brackets. The monotonicity oi g,h is again 
not relevant, hence we drop this condition. We may also drop the ‘st’ predicates 
on the universal quantifiers in the antecedent. Hence, ULCps implies that 


(V/, fn) [(3^‘g(.))(Vn°, fc°)A(/„, n, k) A /„, A, k')] 


(V"*fc")(3"*N)F;(/,iV,fc") 


Bringing all standard quantifiers to the front, we obtain 

(V-*g(.),/i,fc") (V/,/„)(3-*iV ) (4.2) 

' [(Vn, k)A{U,gr,, X, n, k) A (Vfc')5(/, U, K k')] ^ E{f, N, fc", x')], 

where the formula in big(gest) square brackets is internal. Applying to the 
underlined quantifier alternation in (14.21) . we obtain 

(V^‘g(.), /i, fn)(3N <* N') (4.3) 

' [(Vn, k)A{U,g^, X, n, k) A (Vfc')H(/, /„, h, k')] ^ E{f, N, k", x')], 

As (14.31) was proved in M, Corollary 11.61 tells us that E-PA"^ proves 

(Vg(.),h,A")(V/,/n)(3iV <* t{g(.),hX)) (4.4) 

'[(Vn, fc)A(/„, g„, X, n, k) A (Vfc')H(/, /„, A, k')] ^ £((/, TV, k" , x')! , 


where t is a term in the language of E-PA"^. Define s(g(.), h, k") := t{g(^.), h, k") as 
in (12.171) and note that (14.41) yields ULCef(s). □ 


There is a constructive version of the uniform limit theorem in Bishop’s Con¬ 
structive Analysis (See [HI Prop. 1.12, p. 86]). 

The uniform limit theorem serves as an example of the class of theorems (in¬ 
volving convergence in the antecedent) which can be treated using the template 
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described in Section 12.31 We now consider the following more challenging theo¬ 
rem, which is |231 Theorem 7.17, p. 152] and moreover contains convergence in the 
consequent. 

Theorem 4.4. Suppose fn is a sequence of functions, differentiable on [a,b], and 
such that fnixo) converges for some point xq on [a,b]. If f^ converges uniformly 
on [a,b], then fn converges uniformly to a function f, and f'{x) = lim„_>.oo fn{x) 
for X € [a, b]. 

We now show that the usual e-5-definition of convergence (relative to ‘st’) is 
equivalent to the nonstandard one in M. Note that we use the ‘real’ version of 
convergence related to ‘lime^o’ instead of ‘lim^^oo’- 

Theorem 4.5. The system M proves that standard and nonstandard convergence 
are equivalent, i.e. for every IR R-function and real x, we have 

(Ve^ 7^ 0)(e « 0 —>■ Xe ~ x) (4.5) 

CA (W*fcO)(3"‘iV°)(V’**£i ^ 0)(|£| < i ^ |xe - xj < i). 

Proof. For the forward implication in (14.51) , nonstandard convergence immediately 
yields (V®*fc)(VM G n)(V£ ^ 0)(|£| < jg —S' |xe — xj < ■^), which in turn yields 

(W‘fc)(3iV)(VM > iV)(V£ ^ 0)(|£| < i ^ |xe - x| < i)), 

and using minimisatiorQ, there is a least such N. By assumption, this N cannot 
be infinite, and is therefore finite, i.e. 

(W‘fc)(3^*7V)(VM > iV)(V£ 7 ^ 0)(|£| < ^ |xe - x| < i), (4.6) 

and we obtain the right-hand side of (14.5L even with the right-most ‘st’ dropped. 
For the reverse implication in (14.51) . the right-hand side of the latter implies 

(Vstfc0)(3st^0)(vst^i i)(o < |^(^)| < ^ ^ < i) (4.7) 

By Theorem 1 1.1 01 every binary sequence is standard in M, and (I4J1) becomes 

(Vstfc0)(3st^0)(v„i i)(o < |r(a)| < i ^ |xq„) - x| « i). (4.8) 

However, every (standard or nonstandard) real also has a standard binary ex¬ 
pansion such that f =ir r(Q!), yielding xj =ir x^(a) by (IREl) . Hence, (14.81) implies 
(Vst^0)(3st^0)(v^i ^ o)(|£| < T ^ |x 5 - x| « i), 

which immediately yields Xg Ri x for 0 yf £ Ri 0. □ 

Let ULD be Theorem [43| formulated with the uniform version of differentiability 
and the notion of limit ‘lime^o’ instead of ‘lim„_>oo’; Let ULDef(t) and ULDns be 
the obvious effective and nonstandard versions. In light of Theorem 14.51 a proof 
of ULD not involving Nonstandard Analysis gives rise to a proof of ULDps. The 
following corollary is thus immediate. 

Corollary 4.6. From a proof of ULD in E-PA“, a term t can be extracted such that 
E-PA'^’ proves ULDef(t). 

Proof. Follow the template sketched in Section 12.31 Note that the normal form of 
convergence is given by ((46ll . □ 

^We could also use underspill instead (See §3]) of minimisation, so as to guarantee that the 
proof goes through in a system not stronger than PRA. 
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In the previous corollary, we made use of the notion of convergence related to 
‘lime-j-o’, as we do not know how to prove a version of 61]) for the notion of 
convergence related to ‘lim„_>oo’- 


4.2. Approximations via M. In this section, we show that from certain classical 
and ineffective existence proofs, we can ‘automatically’ extract approximations to 
the objects claimed to exist, thanks to M. We also show that if the object claimed 
to exist is unique, the approximation converges to it. Note that Wattenberg has 
hinted at the possibility of this kind of results in m- 


Examples of theorems which can be treated in this way are: The intermediate 
value theorem, the Weierstrafi maximum theorem, the Peano existence theorem, 
and the Brouwer fixed point theorem (See [13 II.6 and IV.2]). 


First of all, we treat the Weierstrafi maximum theorem, which is the statement 
that every continuous function on the unit interval attains its maximum. In light 
of Section o we must limit ourselves to uniformly continuous functions. Thus, 
let WEI be the statement that for all / such that (12.31) . we have (3a; S [0,1])(V2/ G 
[0,l]){f{y) < f{x)). Note that WEI is still equivalent to weak Kdnig’s lemma in 
Reverse Mathematics by |29| IV.2.3]. Furthermore, a functional computing the 
maximum from WEI, computes the Turing jump by m Prop. 3.14]. In other 
words, we cannot do much better than the following approximate version from the 
computable point of view. 


(V/ : R R,g) {\/x,y G [0,l],k){\x - y\ < ^ ^ \f{x) - f{y)\ < 

^ (Vfc)(Vj/ G [0, l]){f{y) < mg, k)) + 1)1 . (WEpPP(t)) 


Theorem 4.7. From a proof o/WEI in E-PA'^’ + WKL, a term t can be extracted 
such that E-PA*^ proves WEP'^'^(t). 

Proof. Clearly, a proof of WEI in E-PA'^’ + WKL yields a proof of WEP* in M as 
the latter proves WKL’’* by Corollary II.Ill Next, we show that WEP* implies the 
following nonstandard version of WEI in M: 

(V/ : R ^ R) [(Vx, y e[0,l])[x!^y^ /(x) ss /(y)] (4.9) 

^ (W‘fc0)(3^‘y0 G [0, l])(Vy* G [0, l])(/(y) < f{q) + i)], 

where it is implicitly assumed that codes a rational number. As in the proof of 
Theorem l2.4l uniform e-(5-continuity relative to ‘st’ (as in the antecedent of WEP*) 
is equivalent to nonstandard uniform continuity. On the other hand, the consequent 
of WEP*, namely (d^^x* G [0, l])(V’’*y* G [0, l])(/(y) ^ fix)), immediately yields 

(W‘fc)(3«*x* G [0,l])(V’’*y* G [0,l])(/(y) < /(x) + i), 

and continuity (of the e-(5-variety relative to ‘st’) implies that 

mk)mq° G [0,l])(V^*y* G [0,l])(/(y) < /(g) + i), 

and we trivially obtain that 

(W‘fc)(?*gO G [0,l])(W‘a* <i l)(/(r(a)) < /(g) + i). 
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Since all binary sequences are standard in M by Theorem 11.101 for every real y G 
[0,1], there is a standard <i 1 such that y =ir c(a). By the definition of IR —5> R- 
function, we have /(r(a)) =ir f{y) < f{q) + Hence, we obtain 

G [0, l])(Vj/i G [0, l]){f{y) < /(g) + i), (4.10) 

and (14.91) is seen to follow from WEI®*. Clearly, the consequent of (14.91) is in normal 
form, and the entire implication can be brought into normal form in the same way 
as for CRIns in the proof of Theorem 12.31 To make sure a useful term is extracted, 
modify (14.101) to the following equivalent normal form 

(V®*fc)(3^‘g0 G [0, l])(3^‘lO)(Vyi G [0,1])(^ < [/(g) + i - /(!/)](/)), (4.11) 

Applying term extraction (via Corollarv ll.61) to (14.91) with this modified consequent, 
yields a term t providing an upper bound uq on the code for and Z**. Let s output 
that g** with code at most no such that [/(g)](no) is maximal. Then E-PA"^ proves 
WEP'^'^(s) and we are done. □ 

Let WEI(t)! be WEI with the condition that / has at most one maximum, i.e. 

(Vx, y G [0, l])(a: ^y^ f(x) < sup,,g[o.i] fi^) V fiv) < sup,,g[o.i] /(s^)), 

and the extra conclusion that the maximum of / is given by xq = {t{g, 2®^'^)). 

Corollary 4.8. The system E-PA'^+WKL proves WEI(t)!, where t is the term from 
the theorem. 

Note that unique existence theorems have also been considered in the context of 
constructive Reverse Mathematics (See [S]). 

We emphasise that the results in the previous theorem and corollary are not 
necessarily surprising or deep in and of themselves, especially in light of known 
results in proof mining such as [HUZllIH]. What is in our opinion interesting and 
surprising is that (i) the original proof does not involve Nonstandard Analysis and 
is ineffective, and (ii) the proof of Theorem 14.71 provides a template which can be 
applied to existence statements provable in WKLq. For instance, the previous proof 
immediately generalises to the theorems in the following example. 

Example 4.9 (Approximation theorems). 

(1) The intermediate value theorem. The latter relative to ‘st’ has consequent 
(3®*a:)(/(x) ss 0), yielding the normal form (V®*fc°)(3®*g°)(|/(g)| < i). 

(2) The Peano existence theorem. The latter relative to ‘st’ has consequent 
(3®*(/*^*)(V’**a: G [0, l])((/'(a;) Ri f {x, (j){x))), yielding (V®*A:)(3®*P°)(Va; G 
[0, l])(|P'(x) — f{x,P{x))\ < ^), where P is a polynomial. 

(3) The Brouwer fixed point theorem. The latter relative to ‘st’ has consequent 
(3®*a;)(/(a:) Rs x), yielding the normal form (V®*fc)(3®*g°)(|/(g) - g| < -1). 

As show in m §3], a functional computing any of the objects from these three 
theorems, also computes the Turing jump functional, i.e. approximations are the 
best we can do in general. However, in the special case the object claimed to exist 
is unique (like in Corollary 14.81 or the supremum of a continuous function), our 
approximations do converge to the unique solution. 

In general, the so-called Big Five category of theorems equivalent to WKLq is 
perhaps the largest collection of mathematical theorems in Reverse Mathematics. 
Furthermore, the Reverse Mathematics of WWKLq, the latter a subsystem of WKLq, 
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includes the development of measure theory (See [29l X.l]). In other words, the 
template provided by the proof of Theorem 14.71 is quite general. 

So far, we have not discussed the complexity of the terms t extracted from 
proofs in M. For instance, in Theorem 14.71 the ‘input’ proof does not take place in 
Nonstandard Analysis, and it is a natural question if we can obtain ‘more efficient’ 
terms t from proofs in M which do explicitly exploit techniques from Nonstandard 
Analysis. Now, more efficient terms are usually based on short(er) proofs in proof 
mining (See e.g. |141 §12]), and we provide an example of a ‘very short’ proof in M. 

Remark 4.10 (Short proofs). The following version of (14.911 has a trivial proof: 

(V"*g^)(V/ : IR ^ R) [(Vx, y e [0,1], ^°)(|a: - y\ <^ \f{x) - f{y)\ < j) 

^ (V^‘A:0)(V^‘y € [0, 6 [0, l])(/( 2 /) « /(g) + ^)], 

where we again assume that is coded by a natural number. Perform the usual 
replacement of reals by their binary representation for the variable y, invoke the 
standardness of the former via Theorem ll.lOl and conclude that ‘st’ may be dropped 
in the quantifier (V®*y S [0,1]) thanks to (IREI) . We thus obtain the following: 

(V®*g^)(V/ : R ^ R) [(Vx, y G [0,1], ^°)(|a: - y\ <^ |/(x) - f{y)\ < \) (4.12) 

^ (V^‘A:0)(Vy G [0, l])(3^*g0 G [0, l]){f{y) « /(g) + ^)], 
and applying R‘^ to the consequent yields: 

(V"‘g^)(V/ : R ^ R) [(Vx, y G [0,1], ;°)(|x - y\ <^ |/(x) - /(y)| < j) (4.13) 

^ (V^‘A:0)(3^*g0 G [0,1])(V2/ G [0, l])(3r <S q){f{y) < f{r) + ^)]. 

In the consequent of (I4.13L ‘<o’ is just ‘<o’, and note that there is tq <o g such 
hat /(ro) is maximal. Hence, (14.131) yields: 

(V"*g^)(V/ : R ^ R) [(Vx, y G [0,1], /°)(|x - y\ <^ |/(x) - /(y)| < j) (4.14) 

^ (V^‘A:0)(3^‘g0 G [0,1])(V2/ G [0, l])if{y) < f{q) + ^)]. 

Bringing all standard quantifiers outside (using again R"^), we obtain that M proves 
the normal form of (14.141) . Applying Corollary 11.61 to the modification involving 
(14.lip , now yields the same conclusion as in the theorem. 

4.3. Equivalence between standard and nonstandard definitions. In this 
section, we discuss the second step in the template from Section 12.31 namely the 
equivalence between standard and nonstandard definitions in M. We shall obtain 
a general criterion for when such an equivalence holds, and apply this criterion to 
the definition of open sets. 

4.3.1. A general criterion. The second step in the template from Section [2.31 relies 
on the fact that the ‘e-S’ definition relative to ‘st’ (of continuity, differentiability, et 
cetera) and the latter’s nonstandard version are equivalent in M. In this context, 
the following property (EEEI is important: 

=rW ^ [l/i(z) GA ^(w)]]. (REF) 

We say that ip is real extensional if it satisfies (iREFl) . and it is easy to find formulas 
concerning real numbers which do not satisfy (iREFl) . However, the innermost uni¬ 
versal formula ,y^)ip{x,y,k, N, f) of e-5-continuity as in (12.31) (and similarly 
for (12.221) 1 has the property (IREpp . if we suppress the parameters /, k, N and code 
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X, y as one real z, converting ip{x, y, k, N, /) into Clearly, (fREFl) is the crucial 

step in the proofs of Theorein l2.4l and l4l5] to guarantee the equivalence between the 
nonstandard and usual definitions (of continuity, differentiability, and convergence). 

In general, one proves, in the same way as in the proof of Theorem 12.41 that 
^ (Vz)^(z) in M for real extensional formulas Furthermore, the 
property (IREFI) implies the following: 

(Vz\u;i)(3n°)(['!/;(z) A |[z](n) - [u;](n)| < ^] (4.15) 

which can intuitively be described as ‘the truth of tpi^) is already determined by a 
finite approximation of the real z\ As it happens, a similar ‘finite approximation’ 
condition holds for choice sequences in intuitionistic mathematics, namely the axiom 
of open data (See e.g. [30l §2.2.6]). 

In conclusion, the property (IREFI) plays a central role related to the equiva¬ 
lences between standard and nonstandard definitions in M; This property also has 
a natural interpretation as in (I4.15|) . 

4.3.2. A case study: Open sets. By way of example, we now establish that for open 
sets of real numbers, the usual definition and the nonstandard one (See [121 p. 75]) 
also coincide inside M, thanks to dEIEI). 

Analogous to Definition ll.81 a set of reals [/ C R is given by a functional /^ : R —>• 
IN where ‘x^ € t/’ is short for fu{x) = 1. Note that with this definition, the formula 
‘x G t/’ satisfies (fREFl) . as fu is real extensional as in m from Definition [m 
The following theorem also goes through for the Reverse Mathematics definition of 
open set (See [551 11-5.6]). 

Theorem 4.11 (M). The definition of open set relative to ‘st ’ is equivalent to the 
nonstandard version, i.e. for every U^, we have 

(y^^x^ e t/)(3"Vi » 0)(V"*2/I)(]x -y\<^r^yGU) 

■fA (V®*x^ G U)yy^){x ~ y ^ y G U). (4.16) 

Proof. Let U be as in the right-hand side of (I4.16|) and resolve ‘Ri’ to obtain: 

G D)(Vl/l)(3«tfV0)(|x -y\<±^yGU). 

Now apply R'^ to obtain 

(V’’*xi G U){3^^M°)yy^){3N° < M){\x -y\< ^y GU), 

which immediately implies the left-hand side of (14.161) . For the forward implication, 
assume the left-hand side of (14.161) . which implies 

(V^‘xi G C/)(3«t^0)(V’^tyi)(|x -y\<^^yGU) (4.17) 

Now fix standard xq G U and let no be the associated number as in (14.171) . Then 
for any y > xq (The case y < xq is treated analogously) such that |xo — yj < ’ 

there is Zq G [0,1] such that xq =r y — zq, and this zq has a (necessarily) standard 
binary expansion aj <i 1, i.e. zq =r r(ao)! implying that y =ir xq — r(ao)- Since 
Xq — r(Q:o) is standard, we have Xg — v(ao) G U, implying that y G C/ by (fRm , as 
required to yield the right-hand side of (|4.16p . □ 
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The generalisation of the previous theorem to more general (topological) spaces 
is now straightforward, especially in light of [191 Definition 3.1.6]. Furthermore, 
since fundamental mathematical notions like connectedness, compactness, and con¬ 
tinuity can be defined in terms of open sets, it is straightforward to prove that the 
aforementioned notions immediately imply the associated nonstandard definitions, 
when working in M (as we established above for continuity). In turn, theorems 
dealing with these notions can be treated using the template from Section [2.31 
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